Model selection in quantile regression models
نویسنده
چکیده
Lasso methods are regularization and shrinkage methods widely used for subset selection and estimation in regression problems. From a Bayesian perspective, the Lasso-type estimate can be viewed as a Bayesian posterior mode when specifying independent Laplace prior distributions for the coefficients of independent variables (Park and Casella, 2008). A scale mixture of normal priors can also provide an adaptive regularization method and represents an alternative model to the Bayesian Lasso-type model. In this paper, we assign a normal prior with mean zero and unknown variance for each quantile coefficient of independent variable. Then, a simple MCMC-based computation technique is developed for quantile regression models, including continuous, binary and left-censored outcomes. Based on the proposed prior, we propose a criterion for model selection in quantile regression models. The proposed criterion can be applied to classical least squares, classical quantile regression (QReg), classical Tobit QReg and many others. For example, the proposed criterion can be applied to rq(), lm() and crq() which is available in an R package called Brq. Through simulation studies and analysis of a prostate cancer dataset, we assess the performance of the proposed methods. The simulation studies and the prostate cancer dataset analysis confirm that our methods perform well, compared to other approaches.
منابع مشابه
Semi-parametric Quantile Regression for Analysing Continuous Longitudinal Responses
Recently, quantile regression (QR) models are often applied for longitudinal data analysis. When the distribution of responses seems to be skew and asymmetric due to outliers and heavy-tails, QR models may work suitably. In this paper, a semi-parametric quantile regression model is developed for analysing continuous longitudinal responses. The error term's distribution is assumed to be Asymmetr...
متن کاملBayesian Quantile Regression with Adaptive Lasso Penalty for Dynamic Panel Data
Dynamic panel data models include the important part of medicine, social and economic studies. Existence of the lagged dependent variable as an explanatory variable is a sensible trait of these models. The estimation problem of these models arises from the correlation between the lagged depended variable and the current disturbance. Recently, quantile regression to analyze dynamic pa...
متن کاملIdentifying Risk Factors for Severe Childhood Malnutrition by Boosting Additive Quantile Regression
Ordinary linear and generalized linear regression models relate the mean of a response variable to a linear combination of covariate effects and, as a consequence, focus on average properties of the response. Analyzing childhood malnutrition in developing or transition countries based on such a regression model implies that the estimated effects describe the average nutritional status. However,...
متن کاملFirm Specific Risk and Return: Quantile Regression Application
The present study aims at investigating the relationship between firm specific risk and stock return using cross-sectional quantile regression. In order to study the power of firm specific risk in explaining cross-sectional return, a combination of Fama-Macbeth (1973) model and quantile regression is used. To this aim, a sample of 270 firms listed in Tehran Stock Exchange during 1999-2010 was i...
متن کاملRobust inference in high- dimensional approximately sparse quantile regression models
This work proposes new inference methods for the estimation of a regression coefficientof interest in quantile regression models. We consider high-dimensional models where the number ofregressors potentially exceeds the sample size but a subset of them suffice to construct a reasonableapproximation of the unknown quantile regression function in the model. The proposed methods are<lb...
متن کامل